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Human  Element 


The  ability  of  organizations  to  compete  will  increasing  depend  on  the 

innovation  of  the  human  element 


Cyber  Security  Landscape 


Stakeholders  recognize  the  importance  of  cyber 
infrastructure  to  our  nation’s  prosperity. 

•  Public  and  private  sector  enterprises  today  are 
highly  dependent  on  information  systems  to  carry 
out  their  missions  and  business  functions. 

•  To  achieve  mission  and  business  success, 
enterprise  information  systems  must  be 
dependable  in  the  face  of  serious  cyber  threats. 

•  To  achieve  information  system  dependability,  the 
systems  must  be  appropriately  protected. 

Source:  “Information  Systems  Under  Attack”,  NIST 
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Disruptive  Challenges. 


“...I’ll  make  cyber  security 
the  top  priority  that  it  should 
be  in  the  21st  century... 
coordinate  efforts  across  the 
federal  government, 
implement  a  truly  national 
cyber-security  policy,  and 
tighten  standards  to  secure 
information...” 

President  Barack  Obama 
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Irregular  Challenges 


Catastrophic  Challenges 


Imperatives 


*  DDR&E  Imperatives* 

—  Accelerate  delivery 

—  Uncertain  future 

—  Reduce  the  cost, 
acquisition  time  and 
risk 

—  Develop  world  class 
STEM  ** 


defeat 

Terrorist 

Networks 


Prevent  Atqui  sit-i  or 
Or  Use  OfWMD 

defend 

Homeland 
In  Depth 


Today's 

Capability 

Portfolio 


Traditional  Challenges 


Shape  Choices  Of 
Counti  res  At  Strategic 
Cross  roa  ds 


Oisruptive  Challenges 


*  The  Honorable  Zachary  J.  Lemnios,  DDR&E 
**  Science,  Technology,  Engineering  and  Mathematics  Capabilities 
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Translatas 

Operational  Concepts  ->  Mission 
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Translatas 

Mission  CapabllUss  ->  System 
Requirements 


Translates 

System  Requirements  ->  Component 
Functions 


Translates 

Component  Functions  ■>  End  Items 


DON  =  Department  of  Navy 


DON  Systems  Engineering  Hierarchy 
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An  Effective  Process  for  Major  Defense  Systems  -  But 
Not  Very  Agile 


Integrated  Defense  Acquisition,  Technology,  and  Logistics  Lite  Cycfe  Management  System 


_  Impacts  of  Technological  Changes  in  the  Cyber  Environment 

^p-  Software  Engineering  Institute  CamegieMellon  * 

©2010  Carnegie  Mellon  University 


irregular  Chaflemptfs 


C*ta-strrvphic  Cha  lleng-es 


Defense  Acquisition  Approach 
-  Systems  Engineering  is  Key  Discipline 


Te  and  Irion-*  I  Challenges 


Disruptive  Challenges 


K 


5  to  1 5  Y^ars 


H 


Concept 

Material 

Technology 

Development 

Enqineerina  & 

Production 

Enqineerina 

Solution 

Manufacturinq 

&  Deployment 

IvIDD 

Analysis 

MS 

MS 

Development 

MS 

LRIP  FRP 

•Transition 
•  Ops  Test&  Eval 
•Training 

•Intel  review 
•  Op  needs 
•Tech 

objectives 

•SCR 

•  DP/Early  SE 

•  AoA 

•  Red  Taming 

•  SEP 

•T&E  Strategy 

A 

£ 

•Threat  assess 
•System  Spec 
•SEP 
♦T&E  plan 

•  SRR  &  PDR 

•  Prototype  dev 
•TRA 

B 

A 

*  CDR 
•TRR 

•Dev test  &  eval 

*  Initial  Ops  Test 

&  Eval 

*  PRR 

•TRA  Update 

e 

£ 

I 


I 


3 


Operations 

•  Sustainment 

*  Disposal 


Technology  and  risk  Reduction 

‘Technology  “push"  investment 
*  T echnology  m  atu  rati  on 
•Phenomenology  measurements 


70-75%  of  Cost  Decisions  Made  Prior 
to  Milestone  A 

Impact  72%  of  Total  Life  Cycle  Costs 


ofANinaiivK 

DP-  Developmental  Planning 
MDD  -  Material  Development  Deehten 
$CR-$y?tem  Cermpt  Review 
$RR- System  Requlreaienn  Review 
SEP -System  Engineering  Plan 
FDR -Preliminary  Design  Review 
CDR- Critical  Design  Review 
TRR-Te^tRea-dlne^s  Review 
PRR-Preduetlen  Rea4lnee?  Review 
LRIP  -  Lew-Rate  Initial  Produetien 
FRP  -  Full  Rate  Production 

Source:  DDR&E 
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Irregular  Challenges 


Catastrophic  Challenges 


Need  for  Space,  Air,  Ground,  Water, 
Underwater  Software-Intensive  Systems 
that  are  Interconnected 


•  Several  million  SLOC  programs;  “Hybrid” 
systems  combining  legacy  re-use,  COTS, 
new  development 

•  Multi-contractor  teams  using  different 
processes;  dispersed  engineering, 
development  &  operational  locations 

•  New  technologies  create 
opportunities/challenges; 

products  change/evolve,  corporations  mutate 

•  Business/operational  needs  change  -  often 
faster  than  full  system  capability  can  be 
implemented 

•  Skillset  Shortfalls;  Cost  and  schedule 
constraints 

•  Demands  for  increased  integration, 
interoperability,  system  of  system  capabilities 

•  Enterprise  perspectives/requirements; 
sustainment  concerns 


Today's 
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Portfolio 


Defend 
Homeland 
in  Depth 


Shape  Choices  Of 
Countires  At  Strategic 
Crossroads 


Traditional  Challenges  Disruptive  Challenges 


Development  Complexity  of 
Software-Intensive  Systems 
is  Increasing 
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Software  Development  Schedule  Trends 

#Years  ~  0.4  *  cube  root  (KSLOC) 
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Thousands  of  source  lines  of  code  (KSLOC) 


•Delaying  software  start  increasingly  risky 

•Need  to  find  ways  to  compress  software  schedules 

•-  Timeboxing;  architecting  for  decoupled  parallel  development 


Ref:  Barry  Boehm 
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Realities  of  Software  Quality 


The  flowchart  might  correspond  to  a  100 
LOC  module  with  a  single  loop  that  may  be 
executed  no  more  than  20  times. 


There  are  approximately  1014  possible  paths 
that  may  be  executed! 


For  any  but  the  smallest  programs,  complete 
path  coverage  for  defect  detection  is 
impractical. 


CD 


Adapted  from  Pressman,  R.S.,  Software  Engineering:  A  Practitioner’s  Approach, 
Third  Edition,  McGraw  Hil,  1992 
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Technological:  Rate  of  Adoption 
The  Cyber  Domain  is  Hotly  Contested 
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Increased  GIG  Complexity 
&  Dependence  equates  to 
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potential  for  increased 
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Source:  DoD 


Defensive  measures  are  outpaced  by  the  well  resourced  sophisticated  threat . .  . 
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Top  System  Engineering  Issues  -  2010 

STRENGTH  THROUGH  INDUSTRY  &  TECHNOLOGY 

•  Increasingly,  urgent  demands  of  the  warfighter  are  requiring  effective 

capabilities  to  be  fielded  more  rapidly  than  the  conventional  acquisition 
processes  and  development  methodologies  allow. 

•  The  quantity  and  quality  of  Systems  Engineering  expertise  is 
insufficient  to  meet  the  demands  of  the  government  and  defense 
industry 

•  Systems  engineering  practices  known  to  be  effective  are  not 
consistently  applied  or  properly  resourced  to  enable  early  system 
definition 

•  Technical  decision  makers  do  not  have  the  right  information  &  insight  at 
the  right  time  to  support  informed  &  proactive  decision  making  to 
ensure  effective  &  efficient  program  planning,  management  & 
execution. 

•  The  development  of  systems  with  a  full  level  of  integrity  (all  technical 
aspects  considered)  is  longer  and  more  expensive  over  the  entire 
lifecycle  as  the  technical  solution  is  iterated  and  reworked  in  later 
stages  of  the  development. 
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Top  Software  Engineering  Issues  -  2010 


STRENGTH  THROUGH  INDUSTRY  &  TECHNOLOGY 


•  The  increasing  demands  of  the  war  fighter  are  requiring  development  of 
software  and  systems  more  rapidly  than  acquisition  models  and 
development  processes  allow. 

•  Inadequate/insufficient  program  planning  and  start-up  has  a  negative 
exponential  impact  on  the  program’s  software  success. 

•  For  complex  systems  and  systems-of-systems,  software  engineering 
practices  are  not  well  defined 

•  There  is  insufficient  attention  given  to  the  overall  software  life  cycle 
activities  including  sustainment  and  changing  threats 

•  Fundamental  system  engineering  decisions  are  made  without  full 
participation  of  software  engineering  (2006  carry  over) 

•  Education  programs  do  not  adequately  address  need  for  software 
engineering  to  be  involved  throughout  the  acquisition  process. 
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Software  Engineering  Trends 
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Disruptive  Challengies. 


•  Software  engineering  will  become  increasing  vital  to  DoD, 
government,  and  commercial  operations. 


•  Software  will  become  increasing  complex  and  connected. 


•  New  technical,  governance,  and  process  concepts  are 
needed  to  handle  increasing  complexity  and 
decentralization. 


•  Software  and  systems  engineering  architectures  are  vital  to 
the  development,  evolution  and  sustainment  of  future 
systems. 

•  Increasing  complex  and  connected  systems  need  to  be 
architected  for  security  and  for  operational  resiliency. 

Source:  SEI 
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What  Makes  Software  Engineering  Different? 
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Disruptive  Challenges. 


•  Essential  Properties  of  Software  differentiate  it  from  other 
kinds  of  engineering  artifacts 


•  Software  Invisibility 

•  No  physical  properties 

•  Complexity 

•  Effort/expense  required  to  construct  it  for  their  size 

•  Conformity 

•  Must  conform  to  exacting  specifications 

•  Software  Changeability 

•  Most  frequently  changed  element 


_  Impacts  of  Technological  Changes  in  the  Cyber  Environment 

Software  Engineering  Institute  CamegieMellon  or.1SSSl^"a'neertni' Work,orce  Develop  « 

©2010  Carnegie  Mellon  University 


Cyber  Engineering  Compared  with  other  Sciences 
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•  Several  areas  of  study: 

Scientific  Study 
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computer  science,  software/ 

chemistry,  and  earth 

disease 

systems  engineering,  IT,  HCI, 

sciences 

prevention/treatment 

social  dynamics,  Al 
•  All  nodes  attached  to/relying  on 
netted  system 

R&D  and  Launch 
Cycle 

10-20  years 

10-20  years 

Significantly  compressed; 
solution  time  to  market  needs  to 
happen  very  quickly 
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Refocusing  University  Curriculums:  Alignment  of 
Software  and  Systems  Engineering 
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OSD  Initiatives:  Graduate  Software  Engineering  Reference  Curriculum  (GSwERC) 


&  Body  ofKnowledge  and  Cumculum  to  Advance  Systems  Engineering  (BKCASE) 
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Moore's  Law:  The  Number  of  Transistors  That  Can  be 
Placed  on  an  Integrated  Circuit  is  Doubling 
Approximately  Every  Two  Years 
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Augustine’s  Law:  Growth  of  Software  -  Order  of 
Magnitude  Every  10  Years 
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Trend  &  Implications:  Augustine’s  Law  Will  Hold 


Need  for  increased  functionality  will  be  a  forcing  function  to  bring  the 
fields  of  software  and  systems  engineering  closer  together 
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UNCLASSIFIED 


Human  Capital:  Society  Drivers 
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Workforce  Size 


Human  Capital:  Society  Drivers 


Workforce  Age 
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Thousands  of  graduates 


Human  Capital:  We  are  in  a  Competition 
for  the  Best  Technical  Talent 
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— China 
— Japan 
— S.  Korea 

— U.S. 

U.K. 

— Germany 


S&E  Indicators,  2008 
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Human  Capital:  Using  Core  Competencies 


+  Accurate  identification  of  required  competencies  are 
important  to  support  the  curriculum  review  and 
development  effort  needed  to  ensure  the  best  and  most 

relevant  training. 


Software  Engineer  III 
Software  Engineer  II 


Knowledge 

Application  domain 
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Requirements  analysis 

System  design 

Project  management 
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Integrated  team  design 

Fagan  inspections 
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Change  control 

Competency  Family 
Software  Engineering 


Current  Resource  Profile  (initial  inventory) 
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Human  Capital:  Changing  Demographics 


Demographics  of  workforce  are  changing  and  different  views  may  emerge 
with  four  generations  to  consider 

Generation  Y  professionals  entering  workforce  will  likely  necessitate  non- 
traditional  training  techniques,  such  as  virtual  approaches 


Silent  Generation 
1928-1945 


Baby  Boomers 
1946-1964 


Generation  X 
1965-1980 


Generation  Y/Millenials 
1981-2000 


Hard  worker 
Respects  authority 
Work  is  obligation 
Formal  communicator 
Work/family  separation 


Workaholic 
Questions  authority 
Works  efficiently 
Competitive 
Little  work/life  balance 


Technically  advanced 
Prefers  informality 
Needs  structure  and  direction 
Direct/immediate  communicator 
Seeks  work/life  balance 


Technically  savvy 
Embraces  diversity 
Requires  supervision 
Indirect/virtual  communicator 
Demands  work/life  balance 
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In  the  Current  Cyber  Environment,  We  Must  Fully  ( 
Engage  the  Software/Systems  Engineering  Workforce 


•Complexity 

•Scope  &  Scale:  number  and  diversity  of  elements 
•Connectivity:  interdependencies  among  the  disparate  elements 

•  Emergent  behaviors:  nonlinear  stochastic  response  functions 

•  Effects  of  non-technical  attributes  and  characteristics 
•Criticality 

•Systems  to  be  continuously  available 

•Able  to  deal  with  Security,  Privacy,  Authenticity,  Accuracy,  requirements  “seamlessly”  & 
without  performance  degradation 

•Compatibility 

•  Integrate  the  newest/fastest  with  the  oldest/slowest 
•Chronology 

•“Idea”  to  “IOC”  measured  in  weeks/months  versus  years/decades 
•Competency 

•Can  the  workforce  develop  the  knowledge  and  abilities  to  adapt  &  survive? 

Source:  DDR&E 
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Questions? 
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